Motivation

In Pulsar, consumers can subscribe to multiple topics by pattern or by passing a list of topics.

However, currently, if you need to modify this pattern, it often requires shutting down the existing consumers and creating new consumers with the new pattern.

This is because in MultiTopicConsumer, each operation is applied to all consumers.

We hope to dynamically add or remove certain topics without affecting other subscribed topics.

We want a way to unsubscribe or close from certain consumers and add new ones without restarting the entire consumer.

Additionally, these changes should remain optional for users who do not need them.

This helps developers experiment with dynamic subscription capabilities without cluttering the core consumer interface.

Verifying this change

• Make sure that the change passes the CI checks.

(Please pick either of the following options)

This change is a trivial rework / code cleanup without any test coverage.

(or)

This change is already covered by existing tests, such as (please describe tests).

(or)

This change added tests and can be verified as follows:

(example:)

• Added integration tests for end-to-end deployment with large payloads (10MB)
• Extended integration test for recovery after broker failure

Does this pull request potentially affect one of the following parts:

If the box was checked, please highlight the changes

• Dependencies (add or upgrade a dependency)
• The public API
• The schema
• The default values of configurations
• The threading model
• The binary protocol
• The REST endpoints
• The admin CLI options
• The metrics
• Anything that affects deployment

Documentation

• doc
• doc-required
• doc-not-needed
• doc-complete

Matching PR in forked repository

PR in forked repository: